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(54) PICTURE DECODING METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To execute the decoding of a picture without 
deteriorating the picture by executing shaping so that an edge smoothly continues on 
a block boundary and providing an edge preservation smoothing filter near the block 
boundary. 

SOLUTION: An edge extraction means 2 extracting an edge signal in 3 picture 
signaland an edge shaping means 9 changing the spatial position of the edge signal so 
that the extracted edge signals are smoothly connected near the block boundary are 
provided. Thena picture smoothing processing means 10 which smoothes a picture 
element on the block boundary while the edge signals in the picture are preserved 
based on the extracted and shaped edge signals executes a decoding picture signal. 
Thusthe continuity of the edge in the picture signal can smoothly be shaped against 
the distortion of the blockwhich occurs in encoding for block divisionand the stepwise 
change of a picture element levelwhich occurs on the block boundarycan be 
smoothed without shading off the edge. 



CLAIMS 

[Claim(s)] 

[Claim 1]In a picture decoding processing method which decrypts a coded image 
signal which carried out block division of the picture and was coded for the block of 
everyWhen taking difference of a noticed picture element and its peripheral pixel to a 
decoded image signalA difference value with a peripheral pixel which is in the same 



side as a noticed picture element across a block borderAn edge extraction means 
which extracts an edge signal in a picture signal by adding by carrying out different 
weighting between difference values of a noticed picture element and a peripheral 
pixel in an opposite hand across a block borderAn edge shaping means which changes 
a spatial position of an edge signal so that said extracted edge signal may be made to 
connect smoothly near the block borderA picture decoding processing method 
forming a picture data-smoothing means which smooths data to a pixel on a block 
border saving an edge signal in a picture based on an edge signal extracted and 
operated orthopedicallyand processing a decoded image signal. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]As opposed to a decryption picture with the block distortion 
produced when this invention decrypts the picture signal in which conversion coding 
was carried out by the discrete cosine transform (DCT) etc.lt is related with the 
picture decoding processing method of removing block distortionwithout extracting 
the edge in a picture signalwithout being influenced by block distortionand edge fading. 
[0002] 

[Description of the Prior Art]In the conversion coding of the picture signal using 
orthogonal transformationsuch as DCTthe picture signal was divided into two or more 
blocksorthogonal transformation was performed to each blockand the conversion 
factor is quantized and coded. When decoding this coded signalfollow operation of the 
above-mentioned coding converselyand perform inverse-code-izinginverse 
quantizationand inverse transformationbut. Since these operations are also performed 
by each block unitthe distortion at the time of the decryption produced by lack of the 
encoded information accompanying the quantization at the time of coding appears 
notably on the boundary of each block. Such distortion is called block distortion. 
[0003]How to connect between blocks smoothly and unite by covering a smoothing 
filter to the pixel near the block border after decryption of 1. picture signalin order to 
remove block distortion conventionally (JP2-57067A) 

2. It codes by setting up the field of a blockor it is a coding side and the additional 
information for distortion correction is created so that the pixel during each' block 
may overlapand the method of decoding based on the information is proposed. 
[0004] 

[Problem(s) to be Solved by the Invention] Howeverthere are the following problems in 
the above methods. 

[0005]Since the edge in the pixel signal which is near the block border by filtering to 
the pixel near the block border in the case of the method of 1. is also smoothed 



simultaneouslydotage of the resulting image may be caused and image quality may 
deteriorate on the contrary. 

[0006]In the case of the method of 2. increase of the amount of information 
transmission from the coding side is causedand the compression ratio of a picture 
signal decreases. 

[0007]The purpose of this invention solves this problem and there is in providing the 
method of performing decoding processing of a picture without producing image 
deterioration. 
[0008] 

[Means for Solving the Problem]In a picture decoding processing method which 
decrypts a coded image signal which this invention carried out block division of the 
pictureand was coded for the block of every in order to solve the above-mentioned 
problemWhen taking difference of a noticed picture element and its peripheral pixel to 
a decoded image signalA difference value with a peripheral pixel which is in the same 
side as a noticed picture element across a block borderAn edge extraction means 
which extracts an edge signal in a picture signal by adding by carrying out different 
weighting between difference values of a noticed picture element and a peripheral 
pixel in an opposite hand across a block borderAn edge shaping means which changes 
a spatial position of an edge signal so that said extracted edge signal may be made to 
connect smoothly near the block borderA picture data-smoothing means which 
smooths data to a pixel on a block border saving an edge signal in a picture based on 
an edge signal extracted and operated orthopedically is formedand it was made to 
process a decoded image signal. 

[0009]That isedge of a decoded image signal which has block distortion after 
decryption of a picture signal is extractedit operates orthopedically so that edge may 
continue smoothly on a block borderand an edge preservation smoothing filter was 
covered near the block border after that. 

[0010]Block distortion can be removed by applying this inventionwithout obscuring 

edge in a picture signal. 

[0011] 

[Embodiment of the Invention]The system configuration figure of the block distortion 
removal method showing an embodiment of the invention is shown in drawing 1 . 
[0012]The coded image signal coded by the publicly known coding mode which used 
orthogonal transformationsuch as a discrete cosine transformwith coding equipment 
(not shown) is inputted into the system of drawing 1 . A coded image signal is first 
changed into a decoded image signal by the decryption machine 1 according to a 
procedure contrary to a coding mode. In coding equipmentin order to divide a picture 
signal into the small block of 8x8 or 16x16 grade and to process 
quantizationcodingetc.the block distortion mentioned above appears. There is a 
phenomenon in which the concentration value of a pixel changes to block distortion 
discontinuously stair-like on a block borderor the shape of edge is distorted. The 



explanatory view about block distortion is shown in drawing 2 . Since luminance levels 
differ when (A) of drawing 2 is seen by A-A' of the block A and the block Bthe 
concentration of a pixel is changing on the boundary of the block A and the block B. 
as for (B) of drawing 2 edge shape is distorted on the boundary of the block A and the 
block B — (A) and (B) — all show block distortion. 

[001 3]In amending these two block distortiondiscontinuous amendment of the edge of 
drawing 2 (A) is performed first. Edge extraction processing is performed by the edge 
extraction means 2 the decoded image signal with the block distortion outputted from 
the decryption machine 1 indicates concrete composition to be to drawing 4 . Edge 
extraction processing is performed here by collapsing the difference operator for edge 
extraction in a decoded image signal. Although the thing of ****** is proposed about 
the difference operatorthis example explains the case where the cross Laplacian 
operator shown in drawing 3 is used as an exampleusing drawing 3 and drawing 4 . A 
general cross Laplacian operator has a window like drawing 3 the difference of a 
noticed picture element and each pixel of that contiguity 4 direction is takenthose 
total is outputtedthat output value serves as edge intensity of that noticed picture 
elementand the absolute value of this edge intensity also becomes largeso that an 
edge component is large. 

[001 4]Howeverif this operator is collapsed in a decoded image signal as it isthe place 
which originally did not have edge in the picture signal for a stair-like change of the 
concentration value of the pixel produced by block distortion on a block border will 
also be judged to be edge. Thereforewhen the window of a difference operator 
straddles a block borderit is desirable to perform edge extraction processing so that 
the influence of the pixel which belongs out of a block may decreasein view of a 
noticed picture element. Thenthe circuit of composition as shown in drawing 4 
performs edge extraction processing. The operation is explained henceforth. 
[001 5]Firstif the window of the operator is scanned in the shape of a raster in the 
decoded image signal topthe picture signal of the portion by which the mask was 
carried out will be inputted into the window from the input part 3 in the edge 
extraction circuit 4and the difference of the noticed picture element p (xy) and 4 
pixels of its contiguity p (x-iy-j) will be taken. And the multiplication of those 
difference values is carried out by the coefficient c (ij)those total is taken by the 
adding machine 5and the value serves as edge intensity of a noticed picture element. 
When the coefficient c (ij) is 1 altogether hereit becomes the usual cross Laplacian 
operator. The coefficient c (ij) changes according to the following operations. When 
level and the vertical counters 6 and 7 count one by one as the window of an 
operator is scanned firstthe counted value expresses the two-dimensional 
coordinates of the noticed picture element p (xy). If the size of a block sets the 
starting point of a scan to (00) at 8 pixels x 8 pixels hereSince the window of an 
operator is in the position of drawing 5 to a block border when a surplus when the 
value of the vertical counter 7 is divided by 8 is Othe difference about the pixel p (y- 



x1) which does not belong to the same block as the noticed picture element p (xy) — 
the value of the coefficient c to a paragraph (01) is set as 0< c (01)<1. Thusby setting 
up the coefficient c (01 disturbance of the edge extraction processing on the block 
border by block distortion can be eased. When the surplus of 8 of the value of the 
vertical counter 7 is 7the surplus of 8 of the value of the 0<c(0-1) <1 horizontal 
counter 6 is 0 and the surplus of 8 of the value of the 0<c(10) <1 horizontal counter 6 
is 7similarly 0<c(-10) <1 perpendicularityWhen the surplus of 8 of the horizontal 
counter 6 is except the aboveall the coefficients are set up by the coefficient set part 
8 so that it may be set to c(ij) = 1. In this wayif edge intensity is called forthe 
absolute value is compared with a predetermined thresholdwhen larger than the 
thresholdit will be judged that a noticed picture element is edgeand the edge intensity 
will be outputted. 0 is outputted when edge intensity is smaller than a threshold. 
[0016]Nextthe edge signal acquired by the edge extraction means 2 is orthopedically 
operated by the edge shaping means 9. Edge plastic surgery is corrected so that the 
edge during a contiguity block may continue smoothly. Although the method by the 
state estimation which made smoothness of the curvature of edgeetc. the constraint 
is also considered about the edge near the block border by edge plastic surgerysince 
it generally serves as a complicated algorithmit uses the briefer edge plastic surgery 
technique for it by this example. 

[0017]Belowbelow the method is explained and the flow of the processing is shown in 
drawing 6 . The pixel near the boundary is scanned first and it searches for an edge 
signal (Step 1 ). The edge signal observed in the window and an edge signal with near 
edge intensity are extracted applying the window of a predetermined size focusing on 
the edge signalif an edge signal is found (Step 2). The center of gravity about the 
spatial position of the extracted edge signal is searched for (Step 3)and the position 
of the edge signal to observe is moved in the direction (Step 4). At this timethe 
coordinates (pxpy) of that centroid position are px=sigmaa(ij) x (ij) and py=sigmab(ij) y 

(u). 

It comes out and calculates. Herex (ij) and y (ij) are load coefficients it is decided in 
the position of the edge signal in a window that the x-coordinate of the edge signal in 
a window and a y-coordinatea (ij)and b (ij) will be. This load coefficient gives large 
dignity to the pixel outside a block borderwhen it attaches to the pixel near the 
noticed picture element greatly and thinks the connectivity of the edge outside a 
block border as important. 

[0018]Thusnewly let the position nearest to the centroid position which fulfills the 
conditions of maintaining continuity with the edge signal which adjoins a noticed 
picture element according to the centroid position for which it asked be a position of 
the noticed picture element. For examplethe present position and centroid position of 
a noticed picture element are connected in a straight linethe movement zone is 
moved in the direction of a noticed picture element one by one from the centroid 
position in the straight-line topand processing which makes the point that 



connectivity with a contiguity edge signal is maintained first the movement zone of a 
noticed picture element is performed. The situation of movement of the position at 
the time of setting the size of a window to 5x5 is expressed with drawing 7 . Suppose 
that the result of having extracted the edge signal with the difference operator is 
drawing 7 (a). Suppose that the point which has * in this figure has an edge signal. As 
a result of searching for the position of the center of gravity from this edge 
signalsuppose that those coordinates became position (pxpy) = (-0.2-1.2) of +. this 
time — the coordinates top of the integral value from (pxpy) with the nearest 
movement zone — it is (-0-1) — it becomes (refer to drawing 7 (b)). 
[0019]The numerals which express the change with them to the pixel which changed 
with change of the position of an edge signal to another field from the original field 
since change arises in the form and size of a field from which the pixel level divided 
by the edge signal differs by change of the position of an edge signal are attached. # 
has shown in drawing 7 (b). 

[0020]In a method like this examplein the place where the edge signal is intricately 
interwoven with each other like the fine portion of the pictures in a picturesince right 
edge is connected [ stop / ********** ]the effect of edge plastic surgery decreases. 
Howeveressentiallysince the block distortion cannot be easily conspicuousit is not 
necessary to perform edge plastic surgery by the details of a picture. Thereforea 
method can also be devised so that the fineness of a picture may be detected and 
edge plastic surgery may not be performed to some extent between the blocks with a 
fine picture above. 

[0021 ]The edge preservation type smooth filter 10 which finally saves the edge 
orthopedically operated by the edge falsework 9 is covered over the pixel near the 
block border. Although this filter 10 performs smoothness using the noticed picture 
element which performs smoothnessand its peripheral pixelsuppose that the pixel 
which is in the opposite hand of a noticed picture element on both sides of the edge 
signal which extracted by the edge extracting part 2 at this timeand was 
orthopedically operated by the edge falsework 9and the pixel from which the field 
changed by edge falsework are not referred to since it is smooth. For examplewhen 
filtering at the place of a state like drawing 8 using the pixel of the field of 3x3the 
pixel used for filtering turns into a pixel of the slash part in a figure. While the edge in 
a picture signal had saved edge by covering such a filter 10the distortion on a block 
border can be reduced. 
[0022] 

[Effect of the Invention]To the block distortion produced by the above composition in 
the coding which performs block divisionthe continuity of the edge in a picture signal 
can be operated orthopedically smoothlyand a stair-like change of the pixel level 
produced on a block border can be smoothedwithout obscuring edge. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is a system explanatory view showing the composition of a block 
distortion removal method. 

[Drawing 2] The explanatory view about block distortion. 
[Drawing 3] The figure showing a cross Laplacian operator. 

[Drawing 4] The block diagram showing the composition of an edge extracting part. 
^Drawing 5] The figure showing the position of a window and a block border. 
[Drawing 6] The flow chart figure showing the flow of edge plastic surgery processing. 
[Drawing 7] The figure showing the state of edge plastic surgery processing. 
[Drawing 8] The figure showing the pixel used for filtering. 
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[0020] 

5©I1-*MMM> J: 5 KX y 5WHN«|t(c£fl| LTV 
£ <!: Z 5?B> IE Ll^x y -7H±*SIfg?- 5 <t (iE 6 & 
xy5*W^^tf'>*<fcoT<*. L 

-7Sfl2£tT*>«V <fc 3 K£2«X£-r 5 C <!: 67$ 5, 
[002 1] Attic. ly5«»9«B8*tlftly 

mnisstowmzMtZo £©7'r;i/'SM oii^ji^s 

t * X y ^SitiJgP 2 Tttffl L, X y 9 TBfg* 



0 8 © <fc 3 ftttfiKOWf 'J >y*fr3 <!: $ . 

7*;U* 'J >?littfchS»RttH*®fMfl:0>WK& 
&3„ co!)J:?*7-f;l/^i o*irt«cil:«k»liy 
?«Mflre*0x •> 5?tt«S L^$7o7 

[0022] 

^5^bT*£i;S7P'yfSIWc«LT, Mtfl* 
*<Z)i y -7©a«l14*7l 6 frfcSUfcf %z.t 7 

□ ? vm±.T&. czmm [y^<o^&^<omt^x y 

v^t^f £ <bfc < TOHbT* z <k tfT** *. 
[HEODfB^ftWW] 

[El 1 ] 7D y 7^^^iC«0^^-r>'77 : Altt 

[02] 7P-y?SWcrp^T0)StBm 
[03] +?^575-77V^U— «fTft 
[@4] i«y-7aiiiaiJ(0«lfie«^-r7ay7H. 
[0 5 ] J&t 7n y *«JI©ttH*ij*TB. 
[06] x y •JMWMm^mti^t 70-ft-h 

Ho 

[07] x'y'jwmmaysm^tva. 
[08] 7-fiu*uv^icflMr*B**sria, 
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